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Abstract — An alternative method for collaborative decoding of 
interleaved Reed-Solomon codes as well as Gabidulin codes for 
the case of high interleaving degree is proposed. As an example of 
application, simulation results are presented for a concatenated 
coding scheme using polar codes as inner codes. 

I. Introduction 

Reed-Solomon (RS) codes are used in many applications, 
often implemented in an interleaved form as outer codes in 
concatenated code designs. By combining and interleaving a 
number / G N of RS codewords, correction of long error bursts 
affecting only a few symbols of the particular underlying 
codewords can be achieved. 

The standard decoding procedure consists of decoding each of 
the interleaved codewords separately. In recent years, methods 
have been investigated which try to decode the individual 
codewords no longer independently but in one step, allowing 
for error correction beyond half the minimum distance d. 
However, in order to decode the maximum possible number of 
errors / = 2), the error vectors are required to be linearly 
independent. 

In m and IS), a collaborative decoding algorithm for general 
linear codes based on Gaussian elimination is derived which is 
able to correct errors up to min{Z, 2} by solving a reduced 
system of I linear equations. Therefore, it is applicable only for 
situations where / can be chosen sufficiently high. Other meth- 
ods based on multisequence shift-register synthesis (MSSRS) 
lEI, m consider the complete system of key equations leading 
to an increased error correcting radius beyond I (but likewise 
smaller than and an improved decoding performance. 

While the decoding complexity is of same order 0{lp) for 
both approaches, in case of high interleaving degrees the 
first method might be preferable from a computational point 
of view as the Gaussian elimination allows for parallelized 
computing of rows and columns (and thus for a reduced 
decoding delay) in contrast to the sequential structure of the 
shift register synthesis algorithm. 

Our considerations are based on the method from {T\ and 
||2]. We adopt the results for the special case of RS codes. 
In contrast to ([T], by using a specific code we obtain a unique 
solution in terms of an error locator polynomial rather than 
a superset of the error locations. More importantly, only the 
first part of each syndrome sequence is required for decoding. 
Furthermore, we will show that in the case of concatenated 



codes with high interleaving degree (I > d — 2), the perfor- 
mance degradation compared to MSSRS is small. 

II. Reed-Solomon Codes and Interleaving 

The authors are aware that the theory of RS codes is 
widely known. However, since our considerations are based 
on extended, non-standard RS codes, a short introduction 
seems to be necessary as well. Although even more general 
definitions as in Uj would be possible, we define a Generalized 
Reed-Solomon (GRS) code of length n and dimension k over 
a finite field F with |F| = q elements as follows: 
Definition 1 (Reed-Solomon code). Let t; := (ui, . . . , w„) £ 
F" be a row vector of n < q different elements of F. Let 
further Vk (k < n) be the vector space of polynomials over F 
with degree < k. Then a Reed-Solomon code QTZS{q] n, k, v) 
is defined as the set of evaluations at v 

{(p(z;i),p(«2),...,pK)) eF" : peVk} 
of all the polynomials from Vk- 

Definition 2. A Reed-Solomon-Code QTZS{q;n,k,v) with 
length n = q — 1 and 

V = (a°,a\...,a«-2) 

with a being a primitive element of F will be referred to as 
nS{q-l,k). 

The extended code of length n = q obtained by adding the 
zero element q/F to the vector v ofTZS{q — 1, fc), i.e. 

V = (0,a°,a\...,a«-2), 

will be called TZS*{q, k). 

The code TZS*{q, k) has one interesting property which has 
been proved in a more general form in ||5] p. 304] and will be 
the foundation of our following considerations: 

Lemma 1. The dual code ofTZS*{q, k) is TZS*{q, q — k), i.e. 
the Vandermonde matrix 
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with m := n~k is a possible parity check matrix ofTZS* (q, k). 
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According to Lemma [T] syndrome calculations in the case 
of TZS* codes are actually polynomial evaluations. Moreover, 
we will show in the following that linear combinations of the 
rows of H lead directly to coefficients of polynomials, the 
roots of which will specify the error locations. 
By grouping I G N codewords of QTZS{q; n, k, v) column- 
wise to a (71 X /)-matrix, we obtain a linear code of length 
{I ■ n), dimension {I ■ k) and minimum distance (n — fc + 1) 
like the individual codes. 

Definition 3 (Interleaved Reed-Solomon (IRS) code). Given 
a certain Reed-Solomon code C := GTZS{q]n,k,v), we 
define an Interleaved Reed-Solomon code TTZS{q; I, n, k, v) 
of interleaving degree I as the set of {n x l)-matrices 



(0 



(a(*))^ eC , i = l,...,l 



each consisting of I column-wise arranged codewords from 
C. In case of C ~ TZS* {q, k), the resulting IRS code will be 
referred to as ITZS* {q, I, k). 

III. Collaborative Decoding 

Assume now that a codeword A e nZS*{q, I, k) is trans- 
mitted over an additive noise channel, so that 

Y = A + E gF"^' 

with some error matrix E e F"^' is received at the channel 
output. Let E he a matrix with exactly / G N non-zero 
rows. We denote the set of indices of these erroneous rows. 
(Clearly, at first / and are unknown to the decoder) 
For collaborative decoding, we arrange the I syndrome se- 
quences generated from Y as columns of a so-called syndrome 
matrix S. The computation can be written formally as a matrix 
multiplication of Y with the parity check matrix H of the 
underlying TZS* code: 

S^HY^H{A + E) = HE^H^Ejr (1) 

with H'^ and Ejr denoting the submatrices of H and E 
consisting only of those columns and rows, respectively, whose 
indices are contained in T. The last equivalence holds because 
all other rows of E are zero. The syndrome matrix takes the 
form 



(2) 



Instead of successively solving (for increasing /*) the com- 



plete system of I ■ {n 



- k - 



/) key equations 



m = 1, 



(3) 



for the coefficients Xj G F of the error locator polynomial 
(Ao := 1), we use a subsystem consisting of I equations only 
to be solved: 



(m) 



Ea 



(4) 



From dUi it follows immediately that the error correcting 
radius, i.e. the maximum number of erroneous rows that can 
be corrected, cannot be greater in our case than 



fn 



min{Z, d—2} 



(5) 



The decoding task then plainly consists in determination of 
the row of S with smallest index (/* + 1) that can be written 
as a linear combination of the former rows. By applying the 
Gauss-Jordan algorithm to the columns of S, we obtain the 
reduced column echelon form (reef) of S: 



rcef(S') 



/I 
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(6) 



Our decoding algorithm will be successful whenever the 
following two conditions are fulfilled: 

Cond. I : The non-zero rows Ei {i G J^) of the error 

matrix are linearly independent. 
Cond. 2 : f < /,„ax holds. 

Actually, Cond. 1 and Cond. 2 are both necessary and suf- 
ficient for correct decoding. We will make some remarks on 
the linear independence condition Cond. 1 later in section W\ 

Theorem 1. If Cond. 1 and Cond. 2 are fulfilled, then /* = 
/ and the polynomial 



A, 



-Ea.- 

from (|6]l 



is the error locator 



built from the elements 
polynomial, i.e. 

K(vi) = <^ i G J" 

holds. 

Proof: See the Appendix. ■ 
Obviously, only the first (/ + 1) rows of S rather than the 
complete (length n — k) syndrome sequences are necessary 
for finding A. Thus, especially if the actual number of errors 
is small, the computational complexity can be reduced signif- 
icantly by successive calculation of the rows of 5'. We will 
discuss this version in section [Vl] 

IV. Codeword reconstruction 

Given the (correctly computed) set T of erroneous columns 
of Y, we are now able to reconstruct Ejr and therefore A = 
Y — E. The matrix equation 



E 



(7) 



defines an over-determined system of linear equations consist- 
ing of Z • (71 — fc) equations and / ■ / unknowns. Since we know 
that (|7| must have a unique solution and since the first / rows 
of the (Vandermonde!) matrix Jf'^ are linearly independent, 
we can restrict to the smaller system 
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with Sy] and -ff^/j denoting the matrices consisting of the 
first / rows of S and if"^, respectively. As mentioned before, 
] is a quadratic - and thus invertible - Vandermonde matrix 
and (O actually an interpolation problem. 
Note that also for calculation of the error values the last rows 
S f+2i ■ ■ ■ 1 Sn-k of the syndrome matrix S are not required. 

V. Failure probability 

As shown before, in case of / < /max the success of the 
decoding procedure solely depends on the linear independence 
of the error vectors. If we assume that the Ei are random 
vectors uniformly distributed over F'\{0}, the probability that 
Cond. 1 is not fulfilled, i.e. that the Ej are linearly dependent, 
can be overbounded for / > 2 by 



-{i+i-n 



1-9 



-/ 



-c+i-/) 



1-1 



(9) 



i-q- 

as shown in f[\. Clearly, the decoder certainly fails if the 
number of erroneous columns exceeds /max- Thus, 



PfifJ)<{ 



/<2 

2 < / < /n 

else 



(10) 



holds as an upper bound for the failure probability under 
assumption of uniformly distributed error vectors. 
Compared to the failure probabilities of the Feng-Tzeng al- 
gorithm as derived in [4], the probabilities for the decoding 
to fail are equivalent for / = /max = (n — fc — 1), but 
decline significantly slower as / decreases. Moreover, for 
I < {n — k — 1) the error correction radius of the Feng-Tzeng 
algorithm, i.e. the number of correctable errors, is in general 
strictly greater than in our case. 

In concatenated code designs where the columns of an outer 
IRS code are encoded by an inner block code, the overall 
frame error rate (FER) can be analytically determined by 



N 



FER = ^ 



N-t 



(11) 



with p being the frame error rate of the inner code. 
Fig. [T] depicts the bounds on the FER as a function of the 
inner code error rate p for various interleaving degrees in the 
range from 9 to 15. Here, a (204, 188) shortened RS code like 
in the DVB standard Q is used. For comparison, the failure 
bounds for MSSRS are plotted as dashed grey lines. 
Whereas for small interleaving degrees / the multisequence 
decoder (the lines of which coincide for / = 9 . . . 14 !) clearly 
outperforms our method, for I > 14 the performance of both 
approaches is nearly identical. 

VI. Complexity 

The computational complexity of the Gauss-Jordan algo- 
rithm is of same order 0{lf^) like the independent decoder 
as well as the multisequence synthesis algorithm (with / and 
/ as defined before). 

As already mentioned, only the first (/ + 1) rows rather than 
the whole matrix S are actually necessary for determination 




Fig. 1. Bounds on the frame eiTor rate (FER) for a (204, 188) IRS code 
with Z = 9 ... 15 for collaborative decoding using (a) Gaussian elimination 
and (b) multisequence shift-register synthesis (MSSRS) 



of the error locator polynomial. In particular, when / ^ I 
the computational complexity may be significantly reduced 
by combining syndrome calculation and actual decoding, 
i.e. by applying a decoding algorithm which in each step 
i = 1 . . . /+1 calculates one additional row of S and performs 
Gaussian elimination on the corresponding {t x Z)-submatrix 
of S until a linearly dependent row is detected. Therefore, the 
complexity of the syndrome calculations reduces to 0{lnf) 
rather than 0{lnd). In the extreme case that no errors have 
occurred, the decoder stops without performing even a single 
finite field multiplication since, due to the special form of H, 
the first coefficient of the I syndrome sequences each simply 
consists of a column sum of Y . 

Moreover, in each step of the Gaussian elimination, the I 
columns of the syndrome matrix S may be transformed at 
the same time by a parallel implementation of the decoder in 
order to achieve further reductions in decoding delay. 

VII. A Note on Gabidulin codes 

Gabidulin codes Q are a class of linear rank metric codes 
which play an important role in random linear network coding 
||8|. Their codewords can be represented either as (m x n)- 
matrices over a finite field with q elements or equivalently 
as vectors over the extension field Fg™ . 
For decoding ^-interleaved Gabidulin codes, a key equation for 
computing the error span polynomial from the syndromes can 
be derived (cf. |9l) analogously to the case of IRS codes 
f 



(12) 



where the operator [j] denotes the pointwise applied q^-th 
power of a vector 

With a slight modification, i.e. by raising the current row Sj 
of S to the power [j] in each elimination step, the algorithm 
presented in this paper is applicable to decoding of interleaved 
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Gabidulin codes as well. In this case, an analogue to the failure 
bound for IRS codes (fTOl i is obtained for decoding interleaved 
Gabidulin codes: 

Theorem 2. The failure probability in case of uniformly 
distributed rank-f error words is upper bounded by 

(O f<2 
Pfif, < < 4 • 2 < / < min{/, d-2} 

[ 1 else 

(13) 

where d denotes the minimum rank distance of the underlying 
Gabidulin code. 

Proof: A proof similar to the proof of Theorem 3.11 in 
lITOl is given in the Appendix. ■ 

VIII. Code Concatenation 

The derivations of failure bounds on the FER here as 
well as in |]4| remain valid only as long as the error vec- 
tors are distributed uniformly over F' \ {0}. In [4|, it was 
demonstrated for small interleaving degrees = 3) that the 
performance degradation due to a different error distribution 
can be neglected when using tailbiting convolutional codes as 
inner codes. Unfortunately, in case of large inner code lengths 
(> 100) this result does not hold anymore as convolutional 
codes produce error vectors of relatively small weight. Instead 
of applying randomizing methods which do not only permute 
the error bits but also increase their amount while introducing 
additional computational complexity, we propose the use of 
an alternative inner coding. 

Polar codes fr\\, first introduced by E. Ankan, are decoded by 
a low-complexity successive decoder which generates estima- 
tions on the source bits one after another, each depending on 
the decisions made before. In case of a wrong decision, long 
error sequences up to the end of the codeword are produced. 
This fact (which could usually be seen as a drawback) makes 
polar codes well suited as inner codes in our case. However, 
the polar successive decoder happens to fail at certain bits 
significantly more likely than at other ones. Therefore, in 
order to meet Cond. 1 it appears favorable to apply random 
permutations to the information bits of the polar code, different 
for each row of the IRS codeword. 

IX. Simulation results 

Finally, we present some examplary simulations to demon- 
strate the tightness of the derived bounds and to show that 
the assumption of random error vectors can be realized in 
practice. As an application example closely related to the 
DVB-X standards (first version) |[6], a (256,128) polar code as 
inner code together with the (204,188) IRS code from section 
rvl is used. As the corresponding IRS code is able to correct 
up to 15 erroneous columns, we chose an interleaving degree 
of ; = 16 rather than Z = 12 in the DVB standard. In Fig. |2] 
the frame error rate (FER-) performance of the concatenation 
design including polar codes is compared to a concatenation of 
an inner rate 1/2 convolutional code (constraint length K = 7) 
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Fig. 2. Simulated and analytical frame error rate (PER-) performance of a 
1 = 16 concatenated code with an outer RS(204,188) code and (a) an inner 
(256,128) polar code with standard decoding, (b) an inner (256,128) polar 
code with improved decoding, (c) an inner rate 1/2 convolutional code with 
constraint length K = 7 

with an independently decoded outer (204, 188) RS code as 
used in the DVB standard. By using an improved polar de- 
coding scheme as considered in fT2\, the performance can be 
further enhanced by about 0.3 dB. Simulation results of those 
improved polar codes are represented by circular markers. Fig. 
|2] shows that the simulation points of both decoding schemes 
meet the theoretical failure bound very accurately. Both IRS- 
polar concatenation schemes clearly outperform the DVB code 
in terms of frame error rates as well as of computational 
complexity. 

Appendix 

A. Proof of Theorem 1: 

Let / < [n — k) denote the actual number of erroneous rows 
and F the set of their indices (both being at first unknown to 
the decoder). The square submatrix of H 

K := {H^)^^.^e¥f''f, (14) 

consisting of the first / rows and the columns with indices 
from of H, is a Vandermonde and thus non-singular matrix 
of full rank /. Therefore, the (/ + l)th row of 

M {H^)f^, G F/ (15) 

is a unique linear combination of the first / rows Kj of K: 

f 

for some Xj E ¥, j = 1, . . . , f . We will now demonstrate how 
these coefficients Xj can be derived from the syndrome matrix 
S. Let ip be the linear mapping defined by Ejr £ F-^^': 

LP : i-^¥' , vi-^v- Ejr. (17) 

By definition of K and /x, 

p{K,) = S, , j = l,...,/ 

V7(/X) = Sf+l 



4 

Hans Kurzweil, Mathis Seidl and Johannes B. Huber, January 12, 2013 



Accepted for ISIT 2011 — Hans Kurzweil, Mathis Seidl and Johannes B. Huber: 
Reduced-Complexity Collaborative Decoding of Interleaved Reed-Solomon and Gabidulin Codes 



By our assumption Cond. 1, Ejr is a matrix of rank /. Thus, 
ip is an injective mapping, and the vectors Sj (j = 1, . . . , /) 
form a basis of the image ip{¥^) C F' of 
Consequently, the (/+l)th row of S is a linear combination of 
the former, uniquely determined by the very same coefficients 
\j as in ( fTSl i: 

/ / 

Sf+, = = Y,\MK,) = Y.^,s,. (18) 

Thus, the actual number of errors / is given by the row 
of S with minimum index that can be written as a linear 
combination of the preceding rows. It is clear that this index 
as well as the coefficients \j can be calculated by performing 
elementary column operations on S. 
Given these coefficients, we define a polynomial 



rf 



(19) 



Due to the special form of H (cf. Lemma [U, the ith column 
if* consists of the consecutive powers of Vi G F. Consequently, 



(20) 



holds if and only if i £ F. Since A is a polynomial of degree 
/ = these are obviously the only roots. Therefore, A is 
the error locator polynomial. ■ 

B. Proof of Theorem 2: 

In the following, we will denote the rank of a (n x fc)-matrix 
S over an extension field F^m of F, by rankgm {S) while the 
rank of the corresponding [n x fcm)-matrix over F^ will be 
referred to as rankq(5). 



Let E e 



ixi 



be an arbitrary additive error word of an l- 



interleaved Gabidulin code, chosen at random from the set 
of matrices with rankq(£J) = / < /max- Let further S G 
F^m' denote the submatrix consisting of the first / rows of 
the corresponding syndrome matrix HE. As the parity check 
matrix H is of maximum rank over Fg, the possible matrices 
S are uniformly distributed over the set 



Sf {A e F^,^' 



rankg(A) = /}. 



It is known (cf. 1131 p. 50]) that the mapping 



a^ : Fgn^ ^ Fgn 



(i eN) 



defines an automorphism of the field F^m . Thus, there exists 
a one-to-one correspondence ?/' between Sf and the set of 
matrices defined by the key equation (fTZt : 

Obviously, the decoding will only fail if rankgm < 
/ for S e Sf. In this case there exists a nontrivial linear 
combination 7^ t; G F^m such that 



holds. Because of rank^m (h) ~ 1 there are at most 

Nf := (g™)'*-^"!' 

possibilities to choose a matrix S G F^m' such that (l2Tl i is 
fulfilled. On the other hand, it is shown in ifTOI that 

\Sf\>\-{rr. 

Consequently, for an arbitrary chosen v, the probability that 
rankgm (■0(5')) < / for a randomly chosen matrix S cannot 
be greater than 

Nf 



<4.(q-)- 



Now the overall failure probability can be upper bounded by 
summing up over the number of all distinct null spaces defined 
by different choices of v. This number is certainly smaller than 



cr™ - 1 ^ ' 



h ■ i;{S) = G F' 



(21) 



because v ^ and because v and av lead to the same null 
space for any nonzero a G F^m . 

Finally, Pfif, I) is bounded by 

Pfif, I) < Pmax • A^ < 4 • (<z'")-('+l--^). 
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